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Abstract 

This work is concerned with the proof-complexity of certifying that optimization problems do not 
have good solutions. Specifically we consider bounded-degree "Sum of Squares" (SOS) proofs, a pow- 
erful algebraic proof system introduced in 1999 by Grigoriev and Vorobjov. Work of Shor, Lasserre, and 
Parrilo shows that this proof system is automatizable using semidefinite programming (SDP), meaning 
that any n-variable degree-d proof can be found in time nP'^'^\ Furthermore, the SDP is dual to the 
well-known Lasserre SDP hierarchy, meaning that the "rf/2-round Lasserre value" of an optimization 
problem is equal to the best bound provable using a degree-d SOS proof. These ideas were exploited 
in a recent paper by Barak et al. (STOC 2012) which shows that the known "hard instances" for the 
Unique-Games problem are in fact solved close to optimally by a constant level of the Lasserre SDP 
hierarchy. 

We continue the study of the power of SOS proofs in the context of difficult optimization problems. 
In particular, we show that the Balanced-Separator integrality gap instances proposed by Devanur et al. 
can have their optimal value certified by a degree-4 SOS proof. The key ingredient is an SOS proof 
of the KKL Theorem. We also investigate the extent to which the Khot-Vishnoi Max-Cut integrality 
gap instances can have their optimum value certified by an SOS proof. We show they can be certified to 
within a factor .952 (> .878) using a constant-degree proof . These investigations also raise an interesting 
mathematical question: is there a constant-degree SOS proof of the Central Limit Theorem? 
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1 Introduction 



In a typical constraint satisfaction problem (CSP) we are given a set of variables V to be assigned values 
from some finite domain Q (often {0, 1}); we are also given a set of local constraints specifying how various 
small groups of variables should be assigned. The task is to find an assignment to the variables which 
minimizes the number of unsatisfied constraints. Sometimes there may also be inviolable global constraints; 
for example, that no domain element is assigned to too many variables. A canonical example is the Balanced- 
Separator problem: given is a graph {V, E) with n vertices which must be partitioned into two "balanced" 
parts, each of cardinality at least n/3; the goal is to minimize the number of edges crossing the cut. 

For such problems, certifying that there is a good solution is in NP; for example, given a graph we 
can efficiently prove that it has a balanced cut of size at most a simply by exhibiting the cut. But what 
about the opposite problem, certifying that every balanced cut has size at least /3? Since this problem is 
coNP-complete it is unlikely that there are efficient certifications for every instance; however there may be 
efficient certifications for specific instances or classes of instances. For example, if we consider a linear 
programming relaxation of a given Balanced-Separator instance and then exhibit a dual solution of value (3, 
this constitutes a proof that every balanced cut in the instance has size at least 

The question is also interesting for problems in P, especially when the complexity of the proof system 
is taken into account. For example, given an unsatisfiable instance Ax = 6 of the 3Lin2 CSP (meaning 
the equations are over F2 and each involves at most 3 variables), there is always an easy-to-verify proof 
of unsatisfiability: a vector y such that A = Q but y^b 0. However finding such a proof requires a 
rather specialized algorithm, Gaussian Elimination. By contrast, unsatisfiable instances of the 2Lin2 CSP 
have simple proofs of unsatisfiability (an unsatisfiable "cycle" of variables) which can be found by a very 
generic "local consistency" algorithm. Indeed, one can view this algorithm as searching for all constant- 
width Resolution proofs of unsatisfiability; the same algorithm works for any "bounded- width CSP" [2]. 

Positivstellensatz proofs. In this work we consider a certain strong proof system for CSPs. It belongs to 
the well-studied class of algebraic proof systems, in which local constraints are represented by polynomial 
equations. To handle global constraints we also allow for polynomial inequalities; this is also natural in 
the context of the linear programs and semidefinite programs used by optimization algorithms. To give 
an example, suppose we have a Balanced-Separator instance {V,E) with V = [n]. We introduce a real 
variable Xi for each i ^ V. Now to say that the optimum value of the instance is larger than /3 is precisely 
equivalent to saying the following system of polynomial equations and inequalities (each of degree at most 2) 
is infeasible: 

A = {Xf = Vi G [n]| U I E > n/3, E Xi < 2n/3| U | ^ i^i - Xjf < /3|. 

^i=l i=l {id)&E ' 

Here the first set of equations enforces Xi € {0,1}, encoding a cut. The second set of inequalities enforces 
that the cut is balanced. The final inequality states that at most /3 edges cross the cut. Now what would 
constitute a proof that A has no real solutions; i.e., that the Balanced-Separator value exceeds /3? One 
certificate would be a formal identity in the polynomial ring IR[Xi, . . . , X„] of the following form: 

" n n 

-l = ^P,-(x2-X,) + C/-(^Xi-n/3) + [/'-(2n/3-E^i) + ^-(/?- E {X,-Xjf)^W, (1) 
i=\ «=i «=i (*J)e-E; 

where Pi, . . . , P„ G IEl[Xi, . . . , X„] and where U,U',V,W G ]R[Xi, . . . , X„] are each sums of squares (SOS), 
meaning of the form Qi + + ' ' ' + Qm foi" some Qi, . . . , Qm G IEl[Xi, . . . , Xn]- Such an identity would 
indeed imply that A is infeasible, since substituting any solution of A into (1) would give a nonnegative 
right-hand side. 
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In fact, a certain refinement [49] of tfie Positivstellensatz of Krivine [32] and Stengle [55] guarantees 
tiiat if A is infeasible then tiiere is always a proof of tiie form (1). A generic "SOS proof system" based on 
tiie Positivstellensatz was introduced around 1999 by Grigoriev and Vorobjov [19]. As with most algebraic 
proof systems it can be difficult to place an a priori upper bound on the degree of the polynomials needed 
for a proof; if we insist on a fixed degree bound d then the proof system becomes incomplete. On the other 
hand this incomplete system has the advantage of being efficiently automatizable, meaning that if a proof 
exists it can be found in time poly(n'^). The algorithm uses semidefinite programming and follows from the 
work of Shor [54], Nesterov [44], Lasserre [33, 34] and Parrilo [47]. See Section 1.1 for more details. 

The power of SOS. Most of the previous relevant work focused on showing SOS-degree (equivalently, 
Lasserre-round) lower bounds. However a recent paper by Barak, Brandao, Harrow, Kelner, Steurer, and 
Zhou [3] brought to light the importance of SOS degree upper bounds for the study CSP approximability. 
That paper considered the strong integrality gap instances known for the notorious Unique-Games CSP [50, 
27, 4] and (essentially) showed that degree-8 SOS proofs can certify that the instances have value close to 0. 
Thus the generic poly(n)-time "level-4 Lasserre SDP" algorithm refutes their having large optimal value. 
This is despite the fact that the instances still have value near 1 after (log log n)^/^ rounds of the rather 
powerful Sherali-Adams SDP hierarchy [50]. 

The purpose of the present paper is to further explore the relevance of SOS proof complexity to the 
algorithmic theory of CSP approximation. Specifically, we show that the Devanur-Khot-Saket-Vishnoi [12] 
instances of Balanced-Separator can have their optimal value well-certified by a degree-4 SOS proof. We 
also investigate the problem of SOS proofs for the Khot-Vishnoi (KV) [29] instances of Max-Cut and raise 
an intriguing mathematical question: is there an SOS proof of the Central Limit Theorem? 

1.1 History 

We review here some of what is known about SOS proofs and SDP hierarchies; for a much more thorough 
discussion we recommend the monograph by Laurent [38]. 

Throughout this work we write X = {Xi, . . . , X„) for a sequence of indeterminates, with the number n 
being clear from context. We say that the real multivariate polynomial u G IR[X] is sum of squares (SOS) if 
u = sf + ••• + for some si, Sm G IR[X]. Any SOS polynomial is nonnegative on all of R"; however, 
as Hilbert [21] showed in 1888 there exist nonnegative polynomials which are not SOS. The first explicit 
example, XfX^{Xf + X^ - 3) + 1, was given by Motzkin in the mid-'60s. Hilbert's 17th Problem [22] asks 
whether every nonnegative polynomial q is the quotient of SOS polynomials; this was solved affirmatively 
by Artin [1]. 

Artin's result also follows from the Positivstellensatz, first proved (essentially) by Krivine [32] and then 
later independently by Stengle [55]. Interestingly, Stengle's motivation was the duality theory of linear 
programming. We state a special case appearing in [6]: 

Positivstellensatz. Let A be a finite set of real multivariate polynomial equations and inequalities, 

^ = {pi = 0,p2 = 0, . . . = 0} U {gi > 0, 92 > 0, . . . , g„/ > 0}, 

with each pi, qj £ Wi[X]. Then A is infeasible if and only if there exist polynomials ri, . . . , and SOS 
polynomials (uj) jc[m'] IEl[-^] such that 

m 

-l = ^riPi+ ^ ^^jH^J- 

i=l JC[m'] jeJ 
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One interesting further special case occurs when A contains only equations, not inequalities. In this case 
the Positivstellensatz says that pi , . . . , pm have no common real roots if and only if the ideal they generate 
contains 1 + u for some SOS u. This special case arises whenever one wants to show that a CSP (with 
no global constraints) is not perfectly satisfiable. (As noted by Shor [53], one can actually reduce to this 
case in general by replacing q > with q — Y"^ = 0, where y is a new indeterminate; indeed, by further 
substitutions of new indeterminates one can reduce to the case where all equations are quadratic.) 

Proof complexity. Extending the NuUstellensatz proof system of Beame, Impagliazzo, Krajfcek, Pitassi, 
and Pudlak [5], Grigoriev and Vorobjov [19] proposed in 1999 the natural propositional proof system based 
on the Positivstellensatz. The complexity measure is degree: i.e., maxi^j{ripi,uj Iljej Qj} (2)- This is 
a static proof system, meaning that one simply exhibits the refutation (2). ' Grigoriev and Vorobjov showed 
that refuting the single equation 

(1 - XoXif + {Xf - X^f + (X| - ^3)2 + • . . + {Xl_^ - Xnf + Xl = Q 

requires a proof of degree at least 2"^^. Relying on some ideas from the work of Buss, Grigoriev, Impagli- 
azzo, and Pitassi [9], Grigoriev showed in 1999 [15, 17] that refuting any unsatisfiable system of F2-linear 
equations requires degree at least D /2, where D is the least width needed to give a Resolution refutation. 
As a consequence he showed that degree Q.{n) is necessary to prove Tseitin tautologies on n- vertex regular 
expander graphs and to prove that the graph Kn has no perfect matching when n is odd. Grigoriev also 
subsequently [16] showed that the "r-Knapsack tautology" requires a proof of degree n + 1 for any real 
rG (§ — ^)f + ^); this is the infeasibility of the system 

{Xl = Xi, . . . = + • • • + X„ = r}, 

for r a non-integer. For more on algebraic proof complexity with inequalities, see e.g. [48, 18]. 

Optimization. We now discuss algorithmic issues. Let u G ]R[x] be a real n-variate polynomial of de- 
gree d. A most basic optimization problem is to determine vaix^w^ u{x). Roughly speaking, this is equiva- 
lent (by binary search) to the problem of deciding whether u{x) > a; further, there is no loss of generality 
in assuming a = 0. Unfortunately, the problem of deciding whether u > is NP-hard as soon as d > 4. 
In 1987, Shor [54] pioneered the idea of replacing the condition u > with the stronger condition that u 
is SOS, and noted that this can be tested in poly(n'^) by solving an SDP feasibility problem. (Here we 
ignore the issue of precision in solving SDPs; see Section 2 for more details.) Shor made the connection to 
Hubert's 17th Problem but not to Positivstellensatz. 

Beginning in 2000, Parrilo [47] and Lasserre [33, 34] independently published several works taking the 
idea further. Parrilo emphasized the viewpoint of Positivstellensatz as a refutation system for polynomial 
inequalities, while Lasserre focused significant attention on the dual SDP "problem of moments". Both 
proposed using poly(n"')-time SDPs to search for degree-d Positivstellensatz refutations, for larger and 
larger d. 

Lasserre also proposed using certain variant forms of Positivstellensatz. For example, if one is opti- 
mizing a polynomial on a compact semialgebraic set K then one can use SDP optimization directly (as 
opposed to using binary search and feasibility testing), thanks to a version of the Positivstellensatz due to 
Schmiidgen [51]. Furthermore, Putinar [49] showed that if K is explicitly compact ("Archimedean") — 
say, one of its defining inequalities is Y17=i -^i ^ ^ — then the Positivstellensatz certificates (2) only 

'Grigoriev and Vorobjov also proposed a certain dynamic version of tiie proof system, analogous to Polynomial Calculus [11]. 
Indeed, [39] had earlier proposed a dynamic proof system based on Positivstellensatz. We do not discuss dynamic proof systems 
further in this paper. 



3 



require u j's with | J| < 1. (Both [51, 49] contained a bug, fixed in [57].) On one hand, in practice there is 
rarely any harm in adding an inequality Yl7=i -^f — ^ ^^^^ large B; on the other hand, eliminating the uj's 
with I J| > 1 may cause the refutation degree to increase. In any case, Lasserre focused on the polynomial 
optimization problem 

mf{p{x)\x eK}, K = {xeWC'\qi{x)>0,...,qm{x)>0}, (3) 

and proposed a hierarchy of SDP relaxations for increasing d, 

inf{L(p) I L : R[X]d IR is a linear map, = 1, and L{u),L{uqi) > for all SOS u}, (4) 

where ]R[-'^]d denotes the ring ]R.[X] restricted to polynomials of degree at most d. This is a relaxation 
because one can take L to be the evaluation map p i— )• p{x*) for any optimal solution x*. (In [3], L{p) is 
written as E[p] and termed the "pseudo-expectation" of p.) We refer to (4) as the degree-d Lasserre moment 
SDP; when d is even it is also known as the level-d/2 (or sometimes d/2 — 1) Lasserre hierarchy SDP. The 
semidefinite dual of (4) is 

sup{/3 \p - /3 = uo + uiQi H h Umqm for some SOS uq,... ,Um withdeg(no), deg{uiqi) < d}, (5) 

which we refer to as the degree-d Lasserre SOS SDP. (One can also allow for polynomial equalities in the 
description of K, either by replacing them with pairs of inequalities, extending the SDP formulations as 
in (2), or by factoring out by the ideal they generate [37].) Assuming K is explicitly compact, Lasserre [34] 
showed that the SOS SDP's value tends to the optimal value as the degree increases. If furthermore K has 
a nonempty interior then there is no duality gap between (4) and (5). Generally K has empty interior for 
discrete optimization problems (e.g., if it includes the constraints Xf = Xi); however, the duality gap issue 
is algorithmically irrelevant since the Ellipsoid Algorithm can't distinguish an empty interior from a small 
interior anyway. This issue is discussed briefly in Section 2. 

Prior optimization results. We conclude by mentioning some known positive and negative results for the 
Lasserre moment SDP relaxation. Around 2001, Laurent [36] considered the Lasserre hierarchy for Max- 
Cut with negative edge weights allowed (i.e., the 2Lin2 CSP). She showed that degree-2 Lasserre optimally 
solves all instances whose underlying graph is a tree, and conversely that there are non-tree instances which 
degree-2 Lasserre does not solve optimally. She similarly characterized the underlying graphs which degree- 
4 Lasserre solves optimally: the i^s -minor-free graphs. Around 2002, Laurent [35] showed that when n is 

2 

odd, the degree-(n — 1) moment SDP relaxation for the Max-Cut problem on Kn still has value ^ (whereas 
the optimum value is ^^^^j^); i.e., the [^^]* level of the Lasserre hierarchy is required to obtain the optimal 
solution. Around 2005, Cheung [10] considered the Knapsack problem and showed that in the optimization 
problem 

inf{Xi + ---+Xn\Xf =Xiyi, Xi + ---+Xn>r}, 

if r = r{n) G (0, 1) is sufficiently small then the Lasserre moment SDP does not find the optimal solution 
(namely, 1) until the degree is "maximal", namely 2n + 2. In 2008, Schoenbeck essentially rediscovered 
Grigoriev's result on F2-linear equations from the moment side, showing that there are n-variable 3Lin2 
instance of value i+o„(l) for which the degree-O(n) Lasserre moment relaxation still has value 1. Building 
on this work, Tulsiani [56] showed degree-r2(n) integrality gap instances matching the known NP-hardness 
factors for a number of CSPs. Guruswami, Sinop, and Zhou [20] showed a degree-r2(n) integrality gap 
instance for the Balanced-Separator problem with factor a > 1, even though this level of NP-hardness 
is not known. They also showed a degree-i7(n) integrality gap instance for the Max-Cut problem with 
factor y|. Around 2010, Karlin, Mathieu, and Nguyen [24] showed that the degree-2t Lasserre moment 
relaxation achieves approximation ratio 1 — j for the general Knapsack problem. 
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1.2 Our contributions: an outline of this work 

Continuing a line of work begun in [3], we investigate whether the 0(l)-degree SOS SDP hierarchy can 
solve known integrality gap instances of problems that are essentially harder than Unique-Games. We focus 
on two such problems: Balanced-Separator and Max-Cut. 

Balanced-Separator. Building on work of Khot-Vishnoi [29] and Krauthgamer-Rabani [31], Devanur, 
Khot, Saket, and Vishnoi (DKSV) [12] gave a family of n-vertex Balanced-Separator instances in which the 
optimal balanced separator cuts an ^( ^"o'gn" ) fraction of the edges, but for which the SDP with triangle 
inequalities has value OCj^j^t^)- This is a factor-0(log log n) integrality gap. Raghavendra and Steurer [50] 
show that a factor-(log log n)^(^) gap persists for these instances even for (log log n)^^^) rounds of the "LH 
SDP hierarchy". The key to analyzing the optimum value of their instances is the KKL Theorem [23] from 
analysis of boolean functions. In this work we give a degree-4 SOS proof of the KKL Theorem. In turn, this 
is used in Section 6 to show the following: 

Theorem. The degree-A SOS relaxation for the DKSV Balanced-Separator instances has value 

Thus just the level-2 Lasserre SDP hierarchy (essentially) solves the DSKV Balanced-Separator instances. 

Max-Cut. Khot and -Vishnoi [29] gave integrality gap instances for the Max-Cut problem, by composing 
their Unique-Games instances with the Khot-Kindler-Mossel-O'Donnell [26] Max-Cut reduction. When 
this reduction is executed with parameter p G (—1,0), one obtains n-vertex Max-Cut instances with optimal 
value at most (arccos p)/tt + o„(l), but for which the SDP with triangle inequalities has value ^ — — 
o„(l). In particular, for p = po ^ —.689, this is a factor-. 878 integrality gap (worst possible, by the 
Goemans-Williamson algorithm [14]). Khot and Saket [28] subsequently showed that this gap persists even 
for (log log log n)^(^) rounds of the Sherali-Adams SDP hierarchy. The key to analyzing the optimum value 
of the KV Max-Cut instances is the Majority Is Stablest Theorem from [42]. This theorem is in turn based 
on an Invariance Principle for nonlinear forms of random variables, together with a Gaussian isoperimetric 
theorem of Borell [8]. We are able to "SOS-ize" Kindler-O'Donnell's recent new proof of the latter [30] 
(it essentially only needs the triangle inequality); however we do not know how to prove the former for 
non-polynomial functional. Thus we currently do not know how to give an SOS proof of the Majority Is 
Stablest Theorem. 

We turn then to a weaker version of Majority Is Stablest known as the "|: Theorem", proved in [25]. 
This proof relies on just the Central Limit Theorem (more precisely, the Berry-Esseen Theorem). We are 
able to give an SOS proof of the CLT Theorem, although not with a fixed constant degree bound. Rather, 
we are able to prove it up to an additive error of 6 using an SOS proof of degree 0(l/(5^). Using this, as 
well as the SOS analysis of the KV Unique-Games instances due to [3], we are able to show the following 
in Section 8: 

Theorem. There exists a universal constant C € N"*" such that the degree-C SOS relaxation for the KV 
Max-Cut instances (with parameter po ~ — .689j is within afactor .952 (> .878) of the optimum value. For 
general p, the relaxation is within afactor of .931 of the optimum. 

A guide to the SOS proofs. Since even conceptually simple SOS proofs can sometimes look a little 
complicated, we give here a brief guide to our SOS proofs. Both of our results rely on the hypercontractive 
inequality for {—1, 1}" due to [7]. Barak et al. [3] already gave a degree-4 SOS proof of one form of this 
inequality. The only trick is that to evade the use of Cauchy-Schwarz in the standard proofs one needs 
to move to a "two-function" version of the inequality. We need SOS proofs of a few other forms of the 
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hypercontractive inequality, which we provide in Section 4. Though the notation is heavy, the proofs are 
essentially straightforward. On the other hand, we remark that we currently do not have an SOS proof of the 
2 — ^ 2A; version of the inequality with sharp constant for any integer k > 2. 

In KKL, hypercontractivity is used to prove the "Small-Set Expansion (SSE) in the Noisy Hypercube" 
theorem. The usual proof of this is very short, but presents a couple of challenges for SOS proofs. One 
challenge is the use of Holder's inequality with exponents 4, |. We are able to get around the fractional 
powers with a couple of tricks, one which is the following: if one needs to SOS-prove, say, p < ^ for 
some nonnegative polynomial q, instead prove that p < | + ^ • g for all real e > 0. The other challenge 
is that the standard proof of the SSE Theorem involves division by a polynomial quantity, something we 
don't see how to do with SOS proofs. Still, we manage to give a short SOS-proof of a weaker version of the 
SSE Theorem which is good enough for our purposes. We remark that our proof is somewhat similar to the 
Barak et al. analysis of the KV Unique-Games instances; however because we work on the SOS side rather 
than the moment side, we need a few extra tricks. Finally, to obtain the Balanced-Separator result, the last 
step is to SOS-prove the KKL Theorem. Even the statement of the theorem involves logarithms, which does 
not look SOS-friendly. We get around this with a variant of the square-root trick just mentioned. 

Moving to our proof of the ^ Theorem, as stated, we need an SOS-proof of the Central Limit Theorem 
(with error bounds). Alternately phrased, we need an Invariance Theorem for linear forms of polynomials, 
specifically with the absolute-value functional. Although this functional is not polynomial, we can replace 
the required statement with something that is: namely, when ai, . . . ,a„ are indeterminates assumed to 
satisfy af + • • • + = 1, we want to upper-bound 

E [f{x){aixi^ h anXn)] < \ - + e, 

a;~{-l,l}" V vr 

where e is an error term involving af, which is small when all Oj's are small. Our SOS proof of this 
is somewhat technically difficult. To proceed, we upper-bound the absolute-value functional to within 6 
by a polynomial Q of high degree; using real approximation theory, 0{l/6'^) suffices. Then we prove an 
Invariance Theorem for linear forms with a high-degree functional; this is feasible for linear forms (but 
not higher-degree ones) because of their subgaussian tails. Unlike in the usual proof of the Berry-Esseen 
Theorem, we need the hypercontractive inequality for high norms here. 

2 The SOS proof system and the SDP hierarchy for optimization 

In this section we give formal details of the Positivstellensatz proof system of Grigoriev-Vorobjov and the 
associated hierarchy of SDP algorithms due to Lasserre and Parrilo. For brevity we refer to these as "SOS 
proofs and hierarchies". 

Definition 2.1. Let X = {Xi, . . . , X„) be indeterminates, let qi, . . . , q-m, ri,. . . , r^' S ]R[X], and let 

A = {qi>0,...,q^>0}U{ri=0,...,rm'= 0}. 
Given p G ]R,[X] we say that A SOS-proves p>0 with degree k, written 

A hfc p>0, 

whenever 

3vi, . . . , Vm' and SOS uq,ui, . . . , Um such that 

m m' 

p = no + ^ Uiqi + ^ VjTj, with deg(no), deg(nig'i), deg(wjrj) < A; Vi G [m], j € [m!]. 

i=l 3=1 
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(Recall we say that w £ R[X] is SOS if it; = sf H h for some Sj G U[X].) 

We say that A has a degree-k SOS refutation if 

A hfc -1 > 0. 

Finally, when A = we will sometimes use the shorthand 

\-k P>0, 

which simply means that p is SOS and deg(p) < k. 

Our notation here is suggestive of a dynamic proof system, and indeed it can be helpful to think of SOS 
proofs this way. For example, adding deductions is not a problem: 

Fact 2.2. // 

A \-k p>0, A' \-k' p'>0, 

then 

AUA' \-^^^k,k') P + p'>0. 

However using transitivity or multiplying together two deductions leads to a worse degree bound when 
applied generically: 

Fact 2.3. Suppose that 

A hfe q[>0, ...,4>0 
(meaning A\-k q'j^> Ofor each i G [£]). Further suppose that 

{q[>0,...,4>0} ^k' P>0. 

Then 

A \-k+k' P>0- 
Fact 2.4. LetA={qi>0,...,qm> 0}, A' = {q[ >0,...,q'^,> 0}. // 

A \-k p>0, A' hfe, p'>0, 

then 

AUA'U{A-A') hk+k' P-P>0, 
where A ■ A' denotes {qi ■ q'j >Q i £ [m] , j G [m!] }. 

Notice that in the above fact we had to explicitly include product inequalities into the hypotheses. This 
is because in general we do not have {q > 0, > 0} h qq' > 0. For example: 

Proposition 2.5. In E,[F, Z], for every k G N, 

{y > 0, Z > 0} \/k YZ > 0. 

Indeed, for all real /3 > 0, 

{Y>0,Z>0} \/k YZ > -p. 
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Proof. Suppose to the contrary that 

YZ + I3 = ui+Yu2 + Zu^ (6) 

for some SOS ui,U2,uz G ]R[y, Z]. We think of the right-hand side of (6) as being in ]R[Z][y]. Let 
kj be the degree of Y in Uj for j = 1, 2, 3; note that ki, are even and k2 is odd. Suppose first that 
maxj/ci, k2,k^} = ki. Then we must in fact have k^ = ki in order to cancel the Y^^ term in the RHS 
of (6). But in fact such a cancelation is impossible because the coefficient on Y^^ in ui will be an even- 
degree polynomial in Z, but the coefficient on Y^'-^ in 113 will be an odd-degree polynomial in Z. The 
remaining possibility is that k2 > ki,k^. In this case we must have k2 = 1, or else the degree of Y on the 
RHS of (6) will exceed 1. Thus ui, n2, us depend only on Z; but then (6) forces U2 = Z, contradicting the 
fact that U2 is SOS. □ 

For more simple examples of the weakness of SOS proofs, see [41, Chap. 2.7]. Here is another one: we 
cannot directly prove > 1 =^ > 1. 

Proposition 2.6. In ^\Y], for every k G N, 

> 1 Vk Y^> 1. 
Proof Suppose to the contrary that one can write 

Y^-l = u + v{Y^ - 1) (7) 

with u,v e M,[Y] being SOS. One cannot have v = because — 1 is not SOS (consider that 0^ — 1 is 
negative). Therefore the highest-degree term in v is of the form cY"^^ for some real c > and some integer j. 
This gives a term cY'^^^'^ on the right-hand side of (7) which must be canceled by u. This is impossible if 
deg(u) = 2j ■ + 4 because the leading coefficient on u will be positive too. So deg(ti) > 2j + 4, but then its 
highest-degree term remains uncanceled on the right-hand side of (7). □ 

On the other hand, one can easily SOS-prove Y^ < 1 =^ Y^ < 1; see Fact 3.3. Furthermore, one can 
Y'^ > 1 ^Y^ > Ihy contradiction: 

Proposition 2.7. In 1R.[Y], for any e > Owe have 

{y^ > i,y2 < 1 _ g} ^4 -1 > 0. 

Proof We leave the case of e > 1 to the reader. Otherwise, write c=l — eG(0,l); then 

-1 = ^(c + Y'){c - Y') + j^iY'- 1) 

and both (c + Y^) and are SOS. □ 

These observations reveal that when fixing the degree of SOS proofs, the SDP simplifications explored 
by Lasserre (see Section 1.1) can be damaging: it may help to multiply together constraint inequalities, and 
direct optimization can be worse than binary searching for refutations. Thus we propose that for optimiza- 
tions problems, one should generically use the SDP hierarchy proposed by Parrilo. I.e., for 

mf{p{x) \ xeK}, K = {x eWC" \ qi{x) >0,. . . , qm{x) > 0}, 

one should assume that K is "explicitly compact" (say, contains the inequality Xf + • • • + < 2P°^y(")) 
and then use binary search to (approximately) find the largest /3 for which 

{QiiQi2 • • • git > : deg{qi^qi2 qij < d} U {p < (3} -1 > 0. (8) 

This can be carried out in poly(n'^, m) time using the Ellipsoid Algorithm.- 

^Determining (8) amounts to checking if a matrix of variables can be PSD wliile satisfying some equalities. One relaxes the 
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3 A few simple SOS preliminaries 

A well-known basic fact (following from the Fundamental Theorem of Algebra) is that every nonnegative 
univariate polynomial is SOS: 

Fact 3.1. Suppose p G ]R[^i] is a univariate real polynomial such that p{t) > Ofor all real t. Then p is 
SOS; i.e., I~deg(p) P > 0. 

The following related result is credited in [38] to Fekete and Markov-Lukacs, with reference also to [41]: 

Fact 3.2. Suppose p G ^[Y] is a univariate real polynomial of degree k such that p{t) > for all real a < 
t < b. 

If k is odd then 

Y >a, b>Y hfc p > 0. 

If k is even then 

{b-Y){Y-a)>0 hfc p>0. 
We now give some additional simple SOS proofs: 

Fact 3.3. y2 < 1 ^2 y < 1, r > -1. 

Proof. The first follows from 1 — Y = ^(1 — Y)"^ + |(1 — Y"^). The second follows by replacing Y 
by -Y. □ 

Fact 3.4. {y < 1, y > -1} ha Y^ < 1. 

Proof 1 - y2 = 1 (1 + Yf{i - y) + i(i - y)2(i + y). □ 

We will need an SOS proof of the fact that Y,Z e {-1, 1} ^ G {-1, 0, 1}: 
Fact 3.5. y2 = = 1 ha (^) = {^f. 

Proof (^) - = (|z - iy)(y2 - 1) + (iz - |y)(z2 - 1). □ 

Fact 3.6. Suppose that A hfc y > -1, y < 1 and that B he Z > W,Z > -W. Then AU B hfc+£ Z > 
YW. 

Proof Z - YW = \{,Z- W){\ + y) + \{Z ^W)(\- Y). □ 

Fact 3.7. Suppose that ^ h^ y' > y and Bhe Z' > Z. Further suppose A' hfc/ Y' > and B' h^/ Z > 0. 
Then AUBUA'UB' h^,,{k+e',k'+e} Y'Z' > YZ. 

Proof This follows from Y'Z' -YZ = Y'{Z' - Z) + Z{Y' - Y). □ 

We now move to Holder- type inequalities. 
Fact 3.8. h2 YZ < \y'^ + \z'^. 

Proof iy2 + -YZ = i(y - zf. □ 
More generally, by replacing Y with e^l'^Y and Z with e~^l'^Z, we obtain: 



equalities to two-sided inequalities with some small tolerance 5 — 2~p°'^'"\ allowing one to run Ellipsoid. If Ellipsoid returns 
a feasible solution it can be made truly PSD at the expense of adding slightly more slack in the equalities. By virtue of the 
compactness, this can adjusted to give a valid SOS proof oi —1 + 5' > 0. 



Fact 3.9. h2 YZ < f + 1-Z'^ for any real e > 0. 

We would also like Young's inequality for conjugate Holder exponents (|, 4), but stating it needs a trick: 
Fact 3.10. h4 Y^Z < + \Z^. 

Proof. \Y^ + \Z^ - Y^Z = + lyz + \Z^){Y - Z) 



^ \\Y'^ + \{Y +^Zf){Y - Zft \Y'^{Y - Zf + {{Y"^ - Z'^f . □ 



By replacing Y with e^/^y and Z with e ^/^Z, we obtain: 
Fact 3.11. h4 y^z < f y4 + j^Z^ for any real e > 0. 
Fact 3.12. // A hfe y > and AhkY < Z, then A hafe Y'^ < Z^. 

Proof. We can deduce Ahk Z > and therefore Ah^ Z + Y > using Fact 2.2. The result now follows 
from Fact 2.4 apphed to - y2 = (Z + y) (Z - y). □ 

Fact 3.13. h2 avgig[„][X2] > {avgi^[^][Xi]f. 

Proof avgig[„] [Xf] - (avgig[„] [Xi])^ = avgij^^^^ [^{Xi - Xjf]. □ 

4 SOS proofs of hypercontractivity 

In the remainder of the work we will use some standard notions from analysis of Boolean functions; see, 
e.g., [46]. All of our main results will require SOS proofs of the well-known hypercontractivity theorems 
on {—1, 1}", first proved by Bonami [7]. To state them, recall that any function / : {—1, 1}" — )■ R can be 
viewed as a multilinear polynomial, 

fi^) = E n^*' ^here f{S) = E [f{x) U ^^]■ (9) 
Then for p S R, the linear operator Tp is defined by mapping the above function to 

SC[n] ies 

Now the p = 2, q > 2 cases of hypercontractivity can be stated as follows: 
Theorem 4.1. Let f : {-1, 1}" R. Then for any real q>2, 

E [\T^f{xW] < E [f{x)Y\ 

a;~{-l,l}" Vq^ a;~{-l,l}" 

Theorem 4.2. Let f : { — 1, 1}" — )■ R have degree at most k. Then for any real q > 2, 

E [|/(^)n<(g-i)('?/2)'=. E [fix)Y'. 

a;~{-l,l}" a;~{-l,l}" 

Note that Theorem 4.2 follows immediately from Theorem 4.1 in case / is homogeneous of degree k. 
It is also known that Theorem 4. 1 and Theorem 4.2 (even its homogeneous version) are "equivalent", in the 
sense that one can be derived from the other using various analytic tricks. 
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As mentioned, we would ideally like to give SOS proofs of these theorems. In order to even state the 
theorems as polynomial inequalities it is required that q be an even integer. For example, when g = 4 we 
may try to SOS-prove 

E [{T.f{x)f]< E [f{xff. 

3;~{-l,l}" Vq^ a;~{-l,l}" 

The meaning of this is that the 2" Fourier coefficients of f are the indeterminates; i.e., we work over the 
ring ]R[/(0), /({I}), • • • , /(N)] and would like to show that 

E [f{x)r- E [(T./(^))4] 

a;~{-l,l}" a;~{-l,l}" -/q^ 

is a sum of squares of polynomials over the indeterminates f{S). Sometimes we will instead use the 2" 
indeterminates ''f{x)" for x G {—1, l}*^ — note that this is completely equivalent because the /(x)'s are 
homogeneous linear forms in the /(5')'s and vice versa; see (9). 

When q is an even integer it is well known that Theorem 4.2 has a much simpler, "almost combinatorial" 
proof. For example, Bonami's original paper proved the homogeneous version of Theorem 4.2 for even 
integer q using nothing more "analytic" than absolute values and Cauchy-Schwarz. (Her proof even obtains 
a slightly sharper constant than {q — The inductive proof of Theorem 4.2 for g = 4 presented 

in [42] is simpler still, using only Cauchy-Schwarz. It is not hard to check that these remarks also apply to 
Theorem 4.1. 

Nevertheless, it's not completely trivial to obtain SOS proofs of Theorems 4.1 and 4.2 when q is an 
even integer, simply because the Cauchy-Schwarz inequality, E[fg] < y^'E[f'^]y/'E[g'^], has square-roots 
in it. The natural substitute is the inequality E[fg] < ^ E[/^] + ^ E[g^] (see Fact 3.8). However fitting this 
into the known proof of, say, the q = 4 case of Theorem 4.2 seems to require an extra trick: moving to a 
"two-function" version of the statement. This is what was done by Barak et al. in [3], wherein the following 
was shown: 

Theorem 4.3. (SOS proof of the two-function, q = 4 version of Theorem 4.2, [3].) 

Let n,ki,k2 S N. For each j = 1,2 and each S C [n] of cardinality at most kj, introduce an 
indeterminate fj{S). For x G { — 1, l}*^, let fj{x) denote fji^) Hies ^i- Then 

h4 E [h{xff2{xf]<^'^^''- E [h{xf]. E [f2{xf]. 

a;~{-l,l}" a;~{-l,l}" a;~{-l,l}" 

Here we similarly give an SOS proof of the g = 4 case of Theorem 4.1. We will need a more general 
statement which allows for some of the ±1 random variables to be replaced by Gaussians; this idea is also 
from [42]. 

Theorem 4.4. (SOS proof of the two-ffinction, q = 4 version of Theorem 4.1.) 

Let n G N. For each j = 1,2 and each S C [n], introduce an indeterminate fj{S). For each z = 
(zi, ...,Zn)G H", let 

m = E Us)\{^^, T^j.iz) = {j=,f^Us)i[zf, 

SC[n] ieS ^ SC[n] ieS 

these are homogeneous linear polynomials in the indeterminates. Let z = (zi, . . . , Zn) be a random vector 
in which the components Zi are independent and satisfy 'E[zi\ = 'Ei[zf\ = 0, E[5;^] = 1, E[2;^] < 9. (For 
example, Rademachers and standard Gaussians qualify.) Then 



K E[(T X • {T.f2{z)f\ < E[/i(^)2] . nf2{z)\ 

Z \/3 z z 



In particular. 



K E[(Ti /i(z))4]<E[/i(z: 



,2i2 
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Proof. The proof of the theorem is by induction on n. For n = we need to show I-4 /i (0)^/2(0)^ < 
/i (0)^/2(0)^, which is trivial. For general n > 1 and (zi, . . . , z„) G we can express fj{zi, . . . , Zn) = 
Zndj{z') + ej{z'), where z' G R"^^ denotes (zi, . . . , Zn-i)» 



59n 



je5\{n} 



es 



Now 



E [(T 1 /i(^))2.(Ti /2(z))^] 

a;~{-l,l}" \/3 



E 

E 



(Tdi)^ + ^z„(Tdi)(Tei) + (Tei)^ ) ( ^zHTdij' + :^^n(Td2)(Te2) + (Te2)^ 



\2 , 2 



where we introduced the shorthand (Td,) for Tj_dj{z') (and similarly for e,). We continue by expanding 
the product and using linearity of expectation, E[2„] = E[z^] = 0, E[2;^] = 1; thus the above equals 

i B[zt] E[(Tdi)2(Td2)2] + i E[(Tdi)2(Te2)2] + i E[(Td2)^(Tei)2] + E[(Tei)2(Te2)2] 



3^L 



+ |E[(Tdi)(Te2)-(Td2)(Tei)]. 



Using Fact 3.8 we have 



h4 I E[(T(ii)(Te2) • (Td2)(Tei)] < | E[(Tdi)2(Te2)2] + f E[(T(i2)'(Tei)2]. 



3^L 



3^L 



By our assumption E[zl] < 9 we have i E[z^] E^/ [(Tfii)2(Td2)^] < E^'[{Tdif{Td2)^]; here we are 
using the fact that E^/ [(Tdi)2(Td2)^] is SOS.^ Thus we have shown 

K E[(Tx /i(z))2.(T. /2(z))2] 

< E[(Tdi)2(Td2)'] + E[(Tdi)2(Te2)2] + E[(Td2)'(Tei)2] + E[{Teif{Tdef]. 

z' z' z' z' 

We use induction on each of the four terms above and deduce 
K E[(T X /i(z))2.(Tx /2(z))2] 

< B[d,{zr] ^d^iz'f] + Eidiiz'f] ^e^iz'f] + B[d2izr] ^eiiz'?] + E[ei(z')2] E[e2(z')'] 

z' z' z' z' z' z' z' z' 

= ndiiz'f + eiiz'f] ■ E[di{z'f + eiiz'f] 



But it is easily verified that E^ [fj (z)"] = E^/ [dj {z') + ej {z') ], completing the induction. 



□ 



^When z' is a discrete random vector this is obvious. In the general case, note that the coefficients of the polynomial in question 
are finite mixed moments of z' . By Caratheodory's convex hull theorem we can match any finite number of moments of z' using 
some discrete random vector z", thereby reducing SOS-verification to the discrete case. We will use this observation in the sequel 
without additional comment. 
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From this we can deduce Theorem 4.3 with the more general class of random variables. (Alternately, it 
is not hard to obtain the following by generalizing the proof in [3].) 

Corollary 4.5. Theorem 4.3 also holds with the more general type of random vector zfrom Theorem 4.4 in 
place of X ~ {—1, 1}". 

Proof. Begin by defining 

'O if|5|>%, 



for j = 1,2, and then applying Theorem 4.4 to gi, §2- This yields 

h4 E[/i(z)V2(z)2] < E[T^/i(^)2] . E[T^/2(^)2]. 

By a standard computation we have 

E[T^/,(z)2] = 3^ • ^here Wf = fjiSf, j = h 2. 

i=0 \S\=i 

We also have Eiz[fj{z)'^] = YliLo ^T^- Thus to complete the proof it remains to show 



3 

ki k2 fci k2 



h4 (x; 3^ • wr) (x^ 3*' • wf) < (x^ 3^=^ • wr) (x; 3^^ • 

i=0 i'=0 i=0 j'=0 

But after distributing out both products, this is immediate from 

h4 3*+^' • Wp ■ wf < 3''^^^^ ■ wf ■ wf 
for each < i < fci, < i' < A;2. □ 

We would also like to have an SOS proof of Theorem 4.2 for even integers q > 4. We content ourselves 
with the following slightly weaker result, the proof of which follows easily from Corollary 4.5: 

Theorem 4.6. (SOS proof of a weakened version of the two-function, even integer q case of Theorem 4.2.) 

Let n,r,ki,k2, ■ ■ ■ , £ N. For each j G [2*"] and each S C [n] of cardinality at most kj, introduce 
an indeterminate fj{S). Let fi{z), . . . , /2' (^) and random vector z be as in Theorem 4.4. Then 



z? 



<3r{fci+...+fc20. JJe[/j(z)2]. 



Proof. The proof is by induction on r. The r = case is trivial. For r > 1, define 

gr-l 2^ 

Fi{z) = n = n fj{z). 

j=l j=2'-i+l 

Note these are degree-2''~^ in the indeterminates. Further, one may express 



Fi(z)= f{T)ll^ 

TC[n] i&T 
\T\<ki+-+k^r-l 
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where f{T) denotes a degree-2'' ^ polynomial in the indeterminates, and similarly for F2. Thus we may 
apply Corollary 4.5 to Fi and F2 and deduce 



\~2r + l E 
Z 



< 3 



fclH \-k2r _ 



21- -1 

n /^•(^)' 



•E 



n /^■(^) 

j=2'— 1+1 



(10) 



By induction we have 



\~2r E 



n /^•(^)' 



Ko"" E 



2'' 



n M^)' 

j=2'— 1+1 



< 3(r-i)(fci+...+V-i) . Yl B[fj{z)% 

2'' 

< 3(r-l)(V-i+i+-+fe20 . B[fj{z)% 

i=2'-i+i 



and aU four expressions above are SOS of degree 2^. Combining these via Fact 3.7 yields 





2r-l 




\~2r + l E 
Z 


n 


•E 

z 









n z^^^) 

j=2'— 1 + 1 



<3(.-i)(fc.+...+fc..).JjE[/,(z)2]. n E[/,(^)2], 



j=2'— 1+1 



which taken together with (10) completes the induction. 



□ 



Corollary 4.7. (SOS proof of a weakened version of the even integer q case of Theorem 4.2.) 

Let n,k £ ¥\. For each S C [n] of cardinality at most k, introduce an indeterminate f{S). Let f{z) and 
random vector z be as in Theorem 4.4. Then for any even integer q >2, 



iil^og^ q]-q)k 



■E[f,{zfr/'. 



□ 



Proof Take r = [loga q] - 1, fi = ■ ■ ■ = fg/2 = f, fq/2+1 = ■■■ = f2r = lm Theorem 4.6. 

5 SOS proofs of SSE in the Noisy Hypercube, and KKL 
5.1 An SOS proof of small-set expansion in the noisy hypercube 

The following well-known theorem concerning small-set expansion (SSE) in the hypercube is due to Kahn, 
Kalai, and Linial [23]: 

Noisy Hypercube SSE Theorem. Let f : {-1, l}"- {-I, 0, 1}. Then for any < p < 1, 

Stab,[/] < E[/Y/('+''\ 
where Stabp[/] denotes (/, Tp/) = ||T^/|||. 
Proof. 

Stab,[/] = ||T^/||2 < = B[\f\'+P]Vi^+P) = E[/2]2/{i+P), 

where the inequality is hypercontractivity (the Holder dual of Theorem 4.1). □ 
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We remark on two special cases: 

Stabi [/] < E[/2]3/2^ Stab^[/] < B[ff-^' < E[/2]i-2679. 

We do not know how to obtain a low-degree SOS proof of either inequality. Nevertheless, we come close in 
the following theorem. We remark again that its proofs bears some similarities to the Barak et al. analysis 
of the KV Unique-games instances [3]. 

Theorem 5.1. (SOS proof of a weakened special case of the Noisy Hypercube SSE Theorem.) 
Let n S N, and for each x € { — 1, 1}" let f{x) be an indeterminate. Then for any real e > 0, 

{/(x) = fixf : Vx} h4 Stab 1 [/] < ^fi^f] (f + 4^ nfi^?]) ■ 

Remark 5.2. From this we can deduce that if / : {—1, 1}" — >• {—1, 0, 1} is an ordinary function then 
Stab^ [/] < E[/(a;)2]5/4^ by taking e = E[/(a;)2] V4_ 

Proof. From Fact 3.1 1 (and the trivial fact Y = Y^ \-i Yp^ = Y'^) we may easily deduce 

y = y3 YZ< f y2 + ^z^. 

Since Stabj_ [/] = Ea;[/(a;)T j_/(a;)] we may therefore obtain 

\/3 

{fix) = fixf : Vx} h4 Stab , [/] < | E[fixf] + ^ B[Trfix)% 

^/3 X '"^ a; 

The result now follows from Theorem 4.4. □ 
5.2 The KKL Theorem 

With the Noisy Hypercube SSE Theorem in hand, we can now give an SOS proof of the famed KKL Theo- 
rem [23], the key ingredient in the analysis of the DKSV Balanced-Separator instances. 

Theorem 5.3. (SOS proof of the KKL Theorem.) 

Let n G N, and for each x G { — 1, 1}" let fix) be an indeterminate. Let r be an indeterminate. Then 
for any reals e > 0, K > 2, 

{/(x)2 = 1 : Vx} U {Inf,[/] < r : Vi G [n]} Var[/] < (f + iT^) + ^) If/]- 

Remark 5.4. From this we can deduce that if / : {—1, 1}" — )• {—1, 1} is an ordinary function and t < ^ 
is a positive real such that Infj[/] < r for all i, then ![/] > ^ logg(^) • Var[/]. This follows by taking 
e = rV4andif = log9(f). 

Proof. We may apply Theorem 5. 1 to each of the derivative "functions" 

D,/(.) = ^'-''■"")-/<-'""'\ 

(These are actually sets of indeterminates, each of which is a homogeneous linear form in the indetermi- 
nates fix).) We can obtain the hypothesis Di/(x) = Dj/(x)'^ from the hypotheses /(x)^ = 1 via Fact 3.5. 
We deduce 

{/(x)2 = 1 : Vx} h4 Stab^ [DJ] < E[DJix)^] + E[DJ(a;)2]) 



•V3 
SBi 
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for each i e [n]. Further, since Inf is SOS and of degree 2 we have 

Inf.[/] < r h4 Inf,[/] • - ^InU[f]) > 0. 
Adding the previous two deductions yields 

{/(a;)2 = l:Vx}U{Inf,[/]<r:VzG[n]} < Inf^/] . (f + ^) 

for each i. Now adding over all i G [n] gives 

{fix)' = 1 : Vx} U {Inf,[/] < r : W G [n]} ^ ISK-ig)!^'!-^!^)^ < (f + j^) I[/]. 

SC[n] 

Moreover, since ^(:^)*~^ ^ ~ holds for all s G [n] (consider s < K and s > JC), 

it follows that 

^2 5^ \S\{^,f^-'f{S)' > Var[/] - 

5C[n] 

By combining the previous two deductions and doing some rearranging, we obtain 

{fixf = 1 : Vx} U {Inf,[/] < r : G [n]} H4 Var[/] < (| + 4^) + 

as claimed. □ 

We can now easily deduce (an SOS proof of) the fact that if / : {—1, 1}" — > {—1, 1} has constant 
variance and all its influences equal then its total influence is ^(logn). For the application to Balanced- 
Separator, we will in fact need a slightly more technical statement: 

Corollary 5.5. ( SOS proof of KKLfor equal-influence functions. ) 

Let n > 81 be an integer and for each x G {—1, 1}" let f{x) be an indeterminate. Define 

A = {f{xf = 1 : Vx} U {Inf 4/] < r : Vz G [n]} 

U {Inf,[/] = Inf,[/] : Vz,i G [n]} U {Var[/] > f } U {![/] < ^ Inn}. 

Then ^ I-4 -1 > 0. 

In fact, the result holds even if we change the equal-influences assumption {Inf = Infj[/] : Vz, j G 
[ri]} to the weaker pair of assumptions {Infj[/] = Infj[/] : Vi,j < n/2} and {Infj/[/] = Infj/[/] : 
Vi',/ > n/2} (assume neven). 

Proof. We will prove the "in fact" statement, assuming n is even. (The reader will see why the original 
statement is also true when n is odd.) Define = ^i<n/2^^^iif] ^^'^ ^^"^^[f] = ^i>n/2^^^iif]' ^'^ 

I[f] = [/] + l(2) [/]. Note that 

{Inf,[/] = Inf,[/] : Vi, j < n/2} Inf,[/] = ^l^if] 

for each i < n/2, and similarly for i > n/2. Since I^^^ [/] , I*^^^ [/] are themselves SOS and of degree 2, we 
get 

{Inf,[/] = Inf,[/] : Vi, j < n/2 & Vi,j > n/2} H Inf,[/] < ^I^'\f] + ^I^'^f] = 
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for each i € [n]. (Note that with the basic equal-influences assumption we can obtain the even stronger 
conclusion Infj[/] = for each i G [n].) We can now employ Theorem 5.3, replacing r by 

Using also Var[/] > |, we obtain that for any reals e > 0, K > 2, 

Select K = logg(9n^/^) and e = n^^/^ to obtain 



2oiii/(./ 14 4 - Vlog9(9nl/2) |^4" '^2" HJ \ J ^ logg(9ni/2) 

= 21ogJ{81n)^[/] + ni/2logg(81n)^[-^] ' ^^^^ 

We now employ < ^ Inn. Since is SOS and of degree 2 we also have 

I[/]<^lnn h4 I[ff<^ln^n. 

Substituting this into (11) yields 

A l~4 i < oT — vai-^ • 4t In n + 1 /9 1 N • 7mn ^ < ^ ln(3) < 0.4, 

4 — 21ogg(81n) 20 ni/2 logg(81n) 400 — 20 \ J — ' 

whence ^ 1-4 -1 > 0. □ 



6 Analysis of the DKSV Balanced-Separator instances 

We recall the Balanced-Separator problem: Given is an undirected multigraph G = {V, E). It is required 
to find a cut S* C y with ^ < |^ < | so as to minimize -^j^p-- The natural polynomial optimization 
formulation has an indeterminate f{x) for each vertex x ^V: 

{x,y)&E 

s.t. f{xf = 1 Vx G 

Thus as discussed in Section 2, the degree-4 SOS SDP hierarchy will use binary search to compute the 
largest /? for which 

{/(x)2 = l:VxGy}u{(^E/(^))'<|}u{^ Y: (^^^)'</3} K -1 > 0. 

The DKSV instances. We now recall the DKSV Balanced-Separator instances [12]. The instances G = 
{y,E) = {Vn,En) are parameterized by primes A^. Let T = { — 1,1}^ x { — 1,1}^, thought of as 
the 2A^-dimensional hypercube graph. Let a act on elements {x, y) G by cyclic rotation of both halves: 
a{x,y) = {xN,xi, . . . ,XN-i,yN,yi, ■ ■ ■ ,yN-i)- The elements a,a^,. . . , = id form a group acting on 
F, partitioning it into orbits Oi , . . . , Om ; 4 of these orbits have cardinality 1 and the remaining (2^^ — 4)/N 
have cardinality A^. A cardinality- A^ orbit O is called "nearly orthogonal" if for all distinct {x, y), {x' , y') G 
O it holds that y), {x' ,y'))\ < 8\/NlogN. Presuming that A^ is sufficiently large, [12] shows that the 
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number n of nearly orthogonal orbits satisfies (1 — ■i/N'^)m < n < m. (This implies N = 0(logn).) For 
typographic simplicity the nearly orthogonal orbits are assumed to be {Oi, . . . , On}, and this set is taken to 
be the vertex set V. We write L C J^" for the "leftover" elements contained in orbits On+i, • • • , C™; writing 
e = -^w we have e = 0{1/N'^). The edges in G are given by the usual hypercube edges in T. More 
precisely, any pair 0,0' G V have either or edges between them, according to whether or not there 
exist {x,y) G 0,{x',y') G C at Hamming distance 1 in There are no self-loops in G because of the 
near orthogonality property. The set of edges E is in one-to-one correspondence with a subset of (almost 
all the) hypercube edges in J^; specifically, all those not incident on L. The authors of [12] use the KKL 
Theorem to prove: 

Theorem 6.1. The DKSV Balanced-Separator instances have optimum value ^ C°fogn^ )- 

(Although we haven't formally verified it, it's very likely that the optimum value of these instances is also 
O ( i^gl^ ) , at least for infinitely many N. The reason is that there is a cr-invariant function / : — {— 1, 1} 
of constant variance and total influence ft{logN); namely, f{x,y) = 1 if x G { — 1, 1}^ contains a "run" 
(with wraparound) of length [log2 N — log2 log log A^J .) 

On the other hand, the main result of [12] is the following: 

Theorem 6.2. The standard SDP relaxation with triangle inequalities for the DKSV Balanced-Separator 
instances has value 0{^^^). 

We show here that this factor 6 (log log n) gap is eliminated when the degree-4 SOS relaxation is used. 

Theorem 6.3. The degree-4 SOS relaxation for the DKSV Balanced-Separator instances has value ^ C°iogn^ )- 

Proof. We need to show 

{/(0)2 = l:V0GF}u{(i E /(0))'<i ^ E ( ^(^^-/(^'^ )'<cl^}h4-l>0 

(12) 

for some constant c > (and N sufficiently large). 

Introduce indeterminates g{x) for all x G = {—1, 1}^ x {—1, 1}^. By Corollary 5.5 it is possible 
to write 

-l = uo + Y,M9{xf-l)+ Wi,{InU[g]-IiiiM)+M^^r[g]-l)+U2{^H2N)-Ilg]), 

x^T l<i<j<N 

N+l<i<j<2N 

(13) 

where uq, ui, U2 are SOS (in the variables g{x)) and all summands have degree at most 4. Now substitute 
into this identity g{x) = f{0) for each x G O G F, and also substitute g{x) = 1 for each x G which is 
not contained in any O ^ V. We now consider what happens to each term in (13). 

First, we notice that the degree of each term cannot increase. The polynomial uq (now over indetermi- 
nates /(O)) remains SOS. The next term, Y2xeT '^xidi^)'^ ~ 1)» becomes of the form Y2oeV ^c'(/('-^)^ ~ ^) 
for some polynomials v'^. We claim that each summand Wij{In{i[g] — Ini j[g]) in the next term drops out 
entirely. This is because when g is viewed as mapping from T to the set of homogeneous degree- 1 poly- 
nomials in the /(C')'s, it is invariant under the action of a, by construction. From this it follows that 
Infj[(jr] = Infj[(7] formally as polynomials for all 1 < i < j < and A^ + l<i<j< 2A^. 

Next we come to the term 'Ui(Var[(^] — |). We have 

Var[5]-| = B [g{xf]-l - E [gix)f. 
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Even after our substitution, Exejrlg^x)'^] — | will provably equal j under the assumption {/(O)^ = 1 : 
VO S y}, so it remains to focus on 

Recalling that ha {Y + Zf < 2Y'^ + 2^^, we deduce 

f^E/(0)y<| ^2 f6 + (l-6)i E /(0))'<26^ + 2(l-6)2-i<i 



(for sufficiently large, since e = 0(l/iV2))^ as needed. 

Finally we come to the term U2(^ ln(2A^) — Let e' denote the fraction of hypercube edges in T 
which are incident on L; note that e' < 2e = 0(1/A^^). After our substitution, we have 



2^ ln(2iV) _ = ^ ln(2iV) - (2iV) E 

edge (a),y) 
in 



a{x)-g{y) ^ ^ 



^ln(2iV)-(2iV)(i_e').^ ^ f^^^^)' -.'•(*), (14) 



where (*) is the average of a number of terms, some of which are (^^)^ = and some of which are of the 
form 

(^im^y = 1 + i(/(o,)2 _ 1) _ + 1)2. 

The above shows that {f{Of = 1 : VO G ha (^^^^^)^ < 1- Hence 

log log n 



log n 



ha (14) > ^ ln(2Ar) - (2iV)(l - e') ■ c'-^ 



which is nonnegative for c sufficiently small, since = 0(logn) and e' = 0(l/iV2). Thus we have 
verified (12). □ 



7 SOS proofs of the CLT and the ^ Theorem 

7.1 An invariance theorem for polynomials of linear forms 

Theorem 7.1. (SOS proof of an Invariance Theorem for polynomials of linear forms.) 

Let ai, . . . ,anbe indeterminates. For any real vector z = (zi, . . . , z^), let i{z) denote the homogeneous 
linear polynomial i(z) = aizi + • • • + a„2;„. Then for any even integer k > Awe have 



al + ... + al<l hafc E[^(G)^] - k^^'^ af< E[£ix)'] < mC)'' 



where G = (Gi, . . . , G„) ~ N(0, 1)" and x ~ {—1, 1}" is uniform. 

Remark 7.2. It is easy to see that Ea;[^(a;)'^] = Eg[^(G)^] formally as polynomials for A; = 0, 1, 2, 3, and 
any odd integer k > 3. 
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Proof. For each integer < z < n, define tlie polynomial 

We will show for each 1 < i < n that 

a? + • • • + < 1 h2fe P^- k^^^^af < < Pi. 



(15) 



The desired result then follows by summing over i. So fix 1 < i < n and write i{z) = i'(z') + aiZi, where 
z' = {zi,.. . ,Zi-i,Zi+i,Zn) and 

i'(z') = aiZi H h tti-iZi-i + aj+iZj+i H h On^n 

does not depend on the indeterminate aj. Denoting Z' = {Gi, . . . , Gj-i, aij+i, . . . , a;„) we have 



Pi — Pi-i — E 
z' 

k/2 



E [(/(Z') + a,Gi)'=-(/(Z') + aia;i 



(16) 



where we used E[G[] = E[a;[] = for r odd and E[G[] = (r — 1)!!, E[a;[] = 1, for r even. The above 
polynomial is evidently SOS, justifying the second inequality in (15). As for the first inequality in (15), we 
have 

H h < 1 l-2j a^^ < af 

for each i G [n] and 2 < j < k/2 because 



(17) 



<-a^^ = (l-a^)« + a« + a« + ... + ar^) 

= I (1 - E 4) + E 4 ) (4 + af + af + • • • + 4^-2); 

y i'=i / 

and, we have 

by Corollary 4.7, the second inequality's SOS proof being 

1 - (E o^f'^-' = 1 + (E 4) + (E 4)^ + (E 4)' + • • • + (E 4)'/^-^"^ 

Combining (17) and (18) via Fact 2.4 



I? + • • • + < 1 h2fc 4^' E\(!{Z'f-''^\ < kOC') 



af. 



Using this in (16), along with (2*1) ((2j — 1)!! — 1) < k^'-''^ for each j, yields the first inequality in (15), 



completing the proof. 



□ 
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7.2 An SOS proof of the f Theorem 

We require the below technical lemma giving a polynomial approximator to the absolute-value function. 
The proof uses some standard methods in approximation theory and is deferred to Appendix A. 

Lemma 7.3. For any sufficiently small parameter (5 > 0, there exists a univariate, real, even polynomial 
P{t) = Q{t^) of degree at most 0(1/5^) such that: 

1. P{t) > \t\forallt E R; 

2. B[P{ag)] < ■ a + 6 < {^a^ + 1) + S for all < o" < 1, where g ~ N(0, 1); 

3. Each coefficient of P is at most 2^^'^^ in absolute value. 

It is not hard to show that among degree-2 polynomials P{t) with P{t) > \t\, the lowest possible value 
of £[^(0^)] is 1, achieved by P{t) = ^ + ^i^- Interestingly, this is also the lowest possible value even when 
degree-4 is allowed: 

Theorem 7.4. Suppose P{t) is a univariate real polynomial of degree at most 4 satisfying P{t) > |t| /or all 
realt. ThenBg^^^Q^i)[P{g)] > 1. 

Proof. Replacing P{t) by ^{P{t) + P{—t)) if necessary, we may assume P{t) is even; i.e., P{t) = a + 
bt^ + ci^ for some real a, b, a. For any M > we have 

i^x(P(0)>0) + fyx(P(l)>l) + X iP(M) > M) 

^x(a>0) + fl5f X (a + 6 + c> 1) + pp^jpg^ x (a + M^ft + M^c > M) 
a + 6 + 3c> 

This completes the proof because E[P(gr)] = a + 6 + 3c and M may be arbitrarily large. □ 

Remark 7.5. Once we allow degree 6 it is possible to obtain a bound strictly smaller than 1. For example, 
P{t) = .333 + .815^2 - .136t^ + .Olt^ > \t\ pointwise, and B[P{g)] = .89. 

The following ";| Theorem", due to [26], is essentially the special case of the Majority Is Stablest 
Theorem in which p — 0^^. We reproduce the proof. 

Theorem 7.6. Let f : {-1,1}" ^ [-1,1] and assume \ f{i)\ < e for alii G [n]. ThenYJl=if{if < 
I + 0{e). 

Proof Let I : {-1, 1}" ^ R be l{x) = Y.l=i and let a = ^YJl=i?{i?- Then 

a^= E [f{x)i{x)]<nn^)\]<'y E [|g|] + 0(ae) = af7| + 0(6)), 

a;~{-l,l}" X g~N(0,l) \^ V j 

the inequality being Berry-Esseen. The result follows after dividing by a and squaring. □ 

Theorem 7.7. (SOS proof of the Berry-Esseen Theorem with li functional.) 

Let ai, . . . ,an be indeterminates, and for each x S { — 1, 1}", let f{x) be an indeterminate. Let 

A = {fix) > -1, f{x) < 1 : Vx} U {a? + • • • + < 1}. 
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Then for any small real 5 > 0, 



n 

x2^ 



a;~{ 1,1}" .^^ 

where we may choose either 



&=V^ or 6= i(af + ... + a^) + ^. 

Proof. For each x G {— 1, 1}", let ^(x) denote aixi + • • • + a„x„, a homogeneous linear polynomial in the 
indeterminates a^. Let P{t) = Q{t^) = ^ c^t^ be the univariate real polynomial in Lemma 7.3, 

fc=0,2,4,...,d 

where d = deg(P) < d{l/6'^). Since P(t) > ±t for all real t, Fact 3.1 tells us that > ±t in 'R[t\. 

Using Fact 3.6 and substituting t = £{x) we deduce 

{fix) > -1, fix) < 1} hrf+i /(x)^(x) < Piiix)). 

Averaging over x yields 

{/(x) > < 1 :Vx} hrf+i E[/(a^)(aia;i+---+a„a^„)] <E[P(£(aj))] = V E[cfc^(a;)^]. 

(19) 



k=0,2A,...,d ^ 



For each even < A; < d, regardless of the sign of c^, Theorem 7.1 implies that 

n 

a? + --- + a2<l h2d EM^r)*^] <EMG)*^] + |cfc|A:0('=) Vat 

a; G 

i=l 

Summing this over k, using Efe |cfc|A;'^('') < and combining with (19) yields 

n 

A E[/(x)(aiiCi + --- + a„^„)] <E[P(^(G))]+dO('^) Vat (20) 

a; G — ' 

j=l 

Let cr^ be shorthand for 'Y^=\ ^f- Note that if we treat oi, . . . , a„ as arbitrary real numbers, we have 

by the rotational symmetry of multivariate Gaussians. Since the left and right sides are polynomials in 
ai, . . . , a„, it follows that (21) also holds as a formal polynomial identity over the indeterminates ai, . . . , a„. 
Now temporarily view o"^ as an indeterminate. From Lemma 7.3 we have that Eg^N(o,i) [Qi^'^o'^)] is upper- 
bounded by both a/- + 5 and ^a'^ + ^ + 5 for all real numbers < cr^ < 1. Thus from Fact 3.2 we have 
the following univariate SOS proof(s): 

(1 - > h,/2 E^ ^jQi^y'^g^)] <yli + ^,\^^ + \ + 5 

(note that Q has even degree). Letting cr^ = XlILi ^1 ^g^i^' we deduce that for either choice of h, 

n \ / " \ 

l-E^n Ean>0 ^ \Qia^g^)]<h + 5 

i=l J \i=l J 3~N(0,1) 

^ al + --- + al<l E[P(£(G))] < & + 

G 
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using (21) and the fact that X^ILi '^1 already SOS. Combining this with (20) yields 

n 

A B[f{x){aiXi + --- + anXn)]<b + 6 + d'^^''^y^al 

X ^ — ' 

i=l 

as needed. □ 

Corollary 7.8. (SOS proof of the f Theorem.) 

For each x € { — 1, 1}", let f{x) be an indeterminate. Define f{S) as usual and write f{i) = f{{i}) 
for short. Let 

A = {/(x)>-l,/(x)<l:Vx}. 

Then for each small real (5 > 0, 

n n 

x2\ 



i=l i=l 
n 

A U {M <r:yie [n]} hg^,/,,) ^ M < I + <^ + ^^^'^'"^ ' r. 

i=l 

Proof. We wish to apply Theorem 7.7 with = f{i) for each i £ [n]. A standard proof shows that 

SC[n\ 

and hence, using Fact 3.4, 

n 

N j;/«'<l. (22) 

1=1 

We may therefore employ Theorem 7.7 (with 6/2 instead of 6) to obtain 

n _ ™ 

A h5(^/,,) E [/(^)(/(l)^i + ... + /(n)^„)]< ij;7(.)2 + i + 1 + 25(1/^^)^ 7(i)l 

But 

E [/(;r)(/(l)^i + ... + /(n);r„)] = ^/(i)2 
is a polynomial identity so we deduce 

"5(1/52) 

i=l i=l 

completing the first part of the proof. Now adding the assumptions /(i)^ < r easily yields 

n n 

A U {M < r : Vz G [n]} h4 ^ /(i)^ < r ^ M < r 

i=l i=l 

using (22) again. The proof is complete. □ 
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8 Analysis of the KV Max- Cut instances 



We recall the Max-Cut problem: Given is an undirected weighted graph G on vertex set V in which the 
nonnegative edge weights sum to 1. We write {x, y) ~ E' to denote that {x, y) is a random edge chosen with 
probability equal to the edge weight. It is required to find a cut 5 C y so as to maximize 'Pr(^x, y)r^E[^ S 
S,y 5 or vice versa]. The natural polynomial optimization formulation has an indeterminate f{x) for 
each vertex x ^V: 

max E [i - \f{x)f[y)] 

S.t. f{xf = 1 Vx G y. 



Thus as discussed in Section 2, the degree-d SOS SDP hierarchy will use binary search to compute the 
smallest (3 for which 

{/(x)2 = l:Vxey}u| E [l-\f[x)f{y)]>p] -1 > 0. 

Unique-Games. The Khot-Vishoi (KV) instances of Max-Cut [29] are given by composing the KKMO 
"noise stability" reduction from [26] with the KV integrality gap instances for Unique-Games (UG). Our 
SOS proof of the ^ Theorem gives us a "black-box" analysis of the KKMO reduction which can essentially 
be "plugged in" to a sufficiently strong SOS analysis of UG instances. Let us now recall the Unique-Games 
problem with label-size k G N+. Given is a regular weighted graph Q = iy ,£) (self-loops allowed) with 
weights summing to 1. Also, given for each edge {u,v) is a permutation t^^v ■ [k] — [k]. We write 
{u, v,7r) £ to denote that edge {u, v) with permutation tt = tTuv is chosen with probability equal to its 
edge weight. The goal is to give a labeling F : V — )• [fc] so as to maximize Pr(„^ ,r)^£;[7r(F(u)) = F{v)]. 
The natural polynomial optimization formulation has an indeterminate Xu,i for each n G V, ? € [/c]: 



max E 



r k 



■i=l 



E 



r k 

■i=l {v,-k)^u 



S.t. i = XuA yu£V,i £ [k] 

k 
i=l 

where we write {v, tt) ~ u in place of {u, ir, tt) ~ £\u=u for brevity. Thus the degree-d SOS SDP hierarchy 
will use binary search to compute the smallest /? for which 



V-u G V,i G [k]} U{J2 Xu,i = 1 : Vu G V} 

i=l 

r k 



U <! E 



EX. 

■i=l 



E 



> /?} -1 > 0- 



Barak et al. [3] have shown that the degree-4 moment SDP proves that the KV family of UG instances 
has a very low optimum value. In fact they show something stronger; one only needs the hypotheses X'^ ■ < 
Xu,i and (avgu j Xu,i)'^ < 1/k'^. Let us make a somewhat more general definition which applies to SOS- 
refutations of any UG instances: 
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Definition 8.1. Given a UG instance Q = (V, £) with label-size k, we say there is a degree-d SOS refutation 
that the fractional assignment optimum is at least (3 if 



>o:yu£V,i£ [k]} u{Y:Xu,^<l■.yuev} 

i=l 

_ k 
U ' ^ ' 



{e Je^u,^- E > /3| -1>0 



The above definition is slightly more demanding than the most natural one, in which the hypotheses 
■ = Xu,i are granted. As mentioned, Barak et al. establish something noticeably stronger anyway: the 
following theorem is essentially proved in [3, Theorem 6.6]:'* 

Tiieorem 8.2. Let Q = G{N, rf) = (V, £) be the Khot—Vishnoi instance of Unique-Games parameterized by 
N (a power of 2) and rj G (0, 1), which has 2^ /N vertices, label-size N, and optimum value at most N^"^. 
Then there is a degree-i SOS refutation that its fractional assignment optimum is at least N^^^'^\ 

We now recall the KKMO [26] reduction from UG to Max-Cut, which is parameterized by p S (— 1, 0). 
Given a UG instance Q with label-size N, the reduction creates a vertex set V with a vertex Wu,x for each 
u £ V and each x G { — 1, 1}^- The probability distribution E on edges for the Max-Cut instance is given 
as follows: 

• draw It ~ V; 

• independently draw {u, vi, tti) and {u, V2, 7T2) from the marginal of £ which has first vertex u; 

• draw "p-correlated strings" (a;, y) from { — 1, 1}^; 

• output the edge {Wui,a:o7ri,Wu2,yo7r2)- 

KKMO make the following easy observation: 

Proposition 8.3. Consider any cut V — )• {—1, 1} in the above-described Max-Cut instance {V, E); specif- 
ically, let us write it as a collection of functions fy : { — 1,1}^ — t- { — 1,1}, one for each v G V. Then the 
value of this cut is 

i-i E [Stabp[5j], 
where Qu '■ {—1, 1}^ — ^ [—1, 1] is defined by gu{x) = E [fv{x o tt)]. 

{n,ii,7r)~£:|„=„ 

As mentioned, the KV Max-Cut instances are formed by composing the KKMO reduction with the KV 
UG instances. Khot and Vishnoi show that for any fixed r/ € (0, 1), the optimum value of the resulting 
Max-Cut instance is at most (arccos p)/7r + OAr(l). Further, using "Majority cuts" it's easy to show (using, 
e.g. [45, Theorem 3.4.2]) that the optimum values is at least (arccos p)/vr — OAr(l). 

The main result of this section is the following: 

Tiieorem 8.4. Fix any small e, 5 > 0. Let Q = (V, £) be a UG instance with label-size N for which there 
is a degree-d SOS proof (d > 2) that its fractional assignment optimum is at most e. Let G = {V^E) 
be the Max-Cut instance resulting from applying the KKMO reduction with parameter p G (—1,0) to Q. 
Then there is a degree d + 0(1/5^) SOS refutation of the claim that the optimum value of G is at least 
i-ip-(i-i)/,3 + 5 + e.2«(V^^). 



■*Take k = 2 therein, in which case Lemma 6.2 is obviated. This still only proves that optimum value of the degree-4 moment 
SDP is small. To get the fact that the optimum value is of the degree-4 SOS SDP is small (and hence that there is a refutation), 
one can either argue that there is no duality gap using ideas from the footnote in Section 2; or, one can use ideas from our proof of 
Theorem 5.1 to reprove their result from the SOS side. 
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Together with Theorem 8.2 this implies: 

Corollary 8.5. Fix any small (5 > 0. Let Q = (V, £) be a Khot-Vishnoi UG instance with label-size N and 
noise parameter rj. Let G = (V, E) be the Max-Cut instance resulting from applying the KKMO reduction 
with parameter p £ (—1,0) to Q. Then there is a degree 0(l/(5^) SOS refutation of the claim that the 
optimum value ofG is at least \-^p-{\- ^)p'^ + & + 2^(1/^') • AT-^^W. 

Corollary 8.6. Consider the KV Max-Cut instances with parameter po ~ —.689. The degree-0{l) SOS 
SDP certifies they have value at most .779, which is within a factor .952 of the optimum. For general p, the 
degree-0{l) SOS SDP certifies a value for the KV Max-Cut instances which is within a factor .931 of the 
optimum, where 

(arccos p)/vr 



.931 
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Before proving Theorem 8.4 we prove a lemma which gives an alternative way to refute a UG instance 
having a good solution: roughly, for most vertices v £ V, its neighbors cannot agree well on what w's label 
should be. 



Lemma 8.7. Let Q = (V, S) be a UG instance with label-size N and suppose there is a degree-d SOS 
refutation that its fractional assignment optimum is at least e. Then also 



> 4e 



-1 > 0, 



where 



N 



A = {Xu,i > : Vx G V,i G [N]} U { ^ < 1 : Vx G V}. 



i=l 



Proof. Given the indeterminates Xu,i, define for each u £ V and i G [N] the homogeneous linear forms 

Yu,i = 2^":« ~^ 2 , [^t),7r(j)]- 

We will apply the assumption regarding the degree-d SOS refutation for Q to the Yu/s. Certainly we have 

N 

A hi Yu,i>0,Y,Yuj <1 
for every u G V, i G [A^]. Indeed, it's not hard to check that to complete the proof we need only verify 

A' / N 21 



A ^2 E 



N 



E Y 



i=l 



v,-7r{i)\ 



>3 E 



El, E 

i=l \V,Tr)r^V 



But this follows from 
E 



Yl Yu,i ■ , E [Y^^-n-U) 



I] , E • E [Y^^„(i)] 



+ iE 



+ 3E 



(where we do not even need the assumptions YliLi Xu,i < 1)- 



□ 



26 



We now give the proof of Theorem 8.4. 
Proof. It is not hard to deduce the following result from Corollary 7.8: 
Corollary 8.8. In the setting of Corollary 7.8, for any p £ (—1, 0) we have 



^ '~0(l/52) 



Stab.m > f • p + (1 - f ) • - 5 - 25(V^^) . 7(,)4. 



It is also easy to check using Fact 3.3 that 

{/,(x)2 = l:Vt;Gy,xG{-l,l}^} h4 gv{x) > -\,g,{x) <\ 
for all t; e y, X G {-1, 1}^. Thus using the above corollary and Proposition 8.3 we obtain 
{/,(x)2 = l :Vz;Gy,xE{-l,l}^} 



^0(l/52) 2 2 



~ r -1* 



r ^ 



. (23) 



Now we bound the error term 2'^(^/'^^) • E^j^viZ^i^i follows. Using the polynomial identity 

(juij) = E(„^)^u[/^(7r(i))] together with Fact 3.12 and Fact 3.13, we have 



h4 E 



AT 



< E 

tt~V 



N 



E E [/„(7r(f))^] 

_i=l V(«,7r)~-u 

On the other hand, it is easy to check that for all i G \N\ and G V, we have 



{f,{xy = 1 : Vx G {-l,ir} h2 /.(i)^ > 0, E fM < 1- 

i=l 



(24) 



(25) 



Since there is a degree-d refutation for Q having a fractional assignment of value at least e, implementing 
Lemma 8.7 with X^^i = fv{i)'^, we have 



N 



{fu{i)' > : Vx G V, i G [N]] U /«(^) < 1 : Vx G V} 



U<^ E 

By Fact 2.3, (25) and (26) give 

{Uxf = 1 : Vt; G V, X G {-1, 1}^} U { 



' N , ^ X 2 

E( E /„(7r(.))2 

i=l V(«,7r)~it 



>4e} -1>0. (26) 



E 



A' / ^ „\2 

E E /„(7r(i)) 



d+4 



Combining (27) and (24), we get 

r r ^ 

{A(x)2 = l:Vt;GV,xG{-l,l}^}u| E 9v{^' 



> 4e h 



d+2 



-1 > 0. 



-I > 0. 
(27) 

(28) 



Finally, combining (28) and (23), we get 
{A(x)2 = l :V?;G V,xG{-l,l}^} 



-1 > 0. □ 
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A An approximator for the absolute-value function 

Here we restate and prove Lemma 7.3. A key tool will be the polynomial approximator to the sgn function 
constructed in [13]. 

Lemma 7.3. For any sufficiently small parameter S > 0, there exists a univariate, real, even polynomial 
P{t) = Q{t^) of degree at most 0{\/5'^) such that: 

1. P{t) > \t\forallt G R; 

2. E[P{ag)] < ^ ■ a + 5 < {^a^ + + S for all < a < 1, where g ~ N(0, 1); 

3. Each coefficient of P is at most 2'^('^'^s(^')) absolute value. 
Proof. We will use the following result from [13, Theorem 3.10]: 

Theorem A.l. For every < e < .1 there is an odd integer d = d{e) = 0(log^(l/e)/e) and a univariate 
polynomial p{t) of degree d satisfying: 
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• pit) G [sgn(t) - e,sgn(t) + e] for all \t\ £ [e, 1]; 

• P{t) G [-1- e,l + e]forall\t\ < e; 

• p{t) is monotonically increasing on the intervals (—00, —1] and [1, +00). 

We can assume without loss of generality that p{t) is odd since the odd part of p{t) (i.e. — p{—t)) /2) 
also satisfies the properties in Theorem A. 1 . 
Given p{t) as in Theorem A. 1, define 

Po{t) = (1 + 2e)p(t/M), where M = ^^"g'^^e) 

and c > 1 is a universal constant to be chosen later. The polynomial po{t) has the following properties: 

• pQ{t) G [1, 1 + 4e] when t £ [Me, M], po{t) £ [-(1 + 4e), -1] when t £ [-M, -Me]; 

• po{t) G [-(1 + 4e), 1 + 4e] for all |t| < Me; 

• Poit) > 1 when t > M, po{t) < 1 when t < -M. 
Finally, define 

P{t) = / po{x)dx + 2Me. 
Jo 

an even polynomial of degree d + 1. We will show that the following hold assuming c is taken sufficiently 
large and then e is sufficiently small: 

(a) P{t) > \t\ for all t £ R; 

(b) B[P{ag)] < yjl ■ a + 0{Me) for all < a < 1; 

(c) Each coefficient of P is at most 2^^'^^ in absolute value. 
The proof is then completed by taking e = (5^/polylog(l/5). 

Properties {a) follows easily from the definition of P{t). It also follows easily from the definition that 
\P{t)\ < 1 + 0{Me) < 2 for all \t\ < 1. It is a standard fact in approximation theory (see, e.g., [52, 43]) 
that if P is a degree d + 1 polynomial satisfying \P{t)\ < b for all |t| < 1 then each coefficient of P{t) is 
at most, say, 6(4e)'^+^ = 2'^^'^) in magnitude. This verifies (c). It remains to establish property (h). For this 
we have 

E[P(ag)] = B[P{ag) ■ l{\ag\ < M}] + B[P{ag) ■ l{\ag\ > M}] (29) 
Regarding the first term in (29) we use that for |t| < M we have |po(*)| < 1 + 4e and hence 

P{t) < {l + 4.e)\t\ + 2Me = \t\ + 0{Me) V|t| < M. (30) 

Thus 

E[P{ag) ■ l{\ag\ < M}] < E[\ag\ ■ l{\ag\ < M}] + 0(Me) < E[\ag\] + 0(Me) = ^1 • a + 0(Me). 

To complete the verification of {b) it therefore suffices to bound the second term in (29) by 0{Me). In fact 
we will show 

B[P{ag)-l{\ag\> Mjj-^Me. (31) 
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Using evenness of P and the fact that it is evidently increasing on [M, oo) we have 

E[P(a5) • l{\ag\ > M}] =2B[P{ag) ■ l{cjg > M}] < 2B[P{g) • l{g > M}]. (32) 

We upper-bound P's value on large inputs using a well-known fact from approximation theory (and a corol- 
lary of the theorem in §33 of [40]): 

Fact A. 2. Let q{t) be a polynomial of degree at most k satisfying \q{t)\ < bfor all \t\ < 1. Then \q{t)\ < 
b\M\^ forall \t\ > 1. 

Applying this fact to p{t) we obtain p{t) < (1 + e)(3t)^ for all t > 1, whence po{t) < 2(3t/M)'^ for all 
t > M, whence 

P{t) = [ po{x)dx + 2Me < 0(M) + 1 ■ 2{3t/Mf < 0(1) • {3t/Mf+^ 
Jo 

for alH > M (we also used M = o{2'^)). Thus 

(32) < 0{^ f+^ ■ E[/+i • l{g > M}] < 0{^)'^+^ ■ 0{dMf+^ exp(-MV2) 

< 2P°iy'°s(i/^)/^ exp(-MV2) = 2P°'yi°g(i/^)/^exp(-c2log2^(l/e)/2e) < Me 

if we choose c to be a large enough universal constant. This completes the justification of (31) and the 
overall proof. □ 
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